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Abstract. We investigate the hierarchical structure of processes using the mathematical 
theory of operads. Information or material enters a given process as a stream of inputs, 
and the process converts it to a stream of outputs. Output streams can then be supplied to 
other processes in an organized manner, and the resulting system of interconnected processes 
can itself be considered a macro process. To model the inherent structure in this kind of 
system, we define an operad W of black boxes and directed wiring diagrams, and we define a 
W-algebra V of processes (which we call propagators, after [RS]). Previous operadic models 
of wiring diagrams (e.g. [Sp2]) use undirected wires without length, useful for modeling 
static systems of constraints, whereas we use directed wires with length, useful for modeling 
dynamic flows of information. We give multiple examples throughout to ground the ideas. 
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1. Introduction 

Managing processes is inherently a hierarchical and self-similar affair. Consider the case of 
preparing a batch of cookies, or if one prefers, the structurally similar case of manufacturing a 
pharmaceutical drug. To make cookies, one generally follows a recipe, which specifies a process 
that is undertaken by subdividing it as a sequence of major steps. These steps can be performed 
in series or in parallel. The notion of self-similarity arises when we realize that each of these 
major steps can itself be viewed as a process, and thus it can also be subdivided into smaller 
steps. For example, procuring the materials necessary to make cookies involves getting oneself 
to the appropriate store, selecting the necessary materials, paying for them, etc., and each of 
these steps is itself a simpler process. 

Perhaps every such hierarchy of nesting processes must touch ground at the level of atomic 
detail. Hoping that the description of processes within processes would not continue ad infini¬ 
tum may have led humanity to investigate matter and motion at the smallest level possible. This 
investigation into atomic and quantum physics has yielded tremendous technological advances, 
such as the invention of the microchip. 

Working on the smallest possible scale is not always effective, however. It appears that the 
planning and execution of processes benefits immensely from hierarchical chunking. To write 
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a recipe for cookies at the level of atomic detail would be expensive and useless. Still, when 
executing our recipe, the decision to add salt will initiate an unconscious procedure, by which 
signals are sent from the brain to the muscles of the arm, on to individual cells, and so on 
until actual atoms move through space and “salt has been added”. Every player in the larger 
cookie-making endeavor understands the current demand (e.g. to add salt) as a procedure that 
makes sense at his own level of granularity. The decision to add salt is seen as a mundane 
(low-level) job in the context of planning to please ones girlfriend by baking cookies; however 
this same decision is seen as an abstract (high-level) concept in the context of its underlying 
performance as atomic movements. 

For designing complex processes, such as those found in manufacturing automobiles or in 
large-scale computer programming, the architect and engineers must be able to change levels 
of abstraction with ease. In fact, different engineers working on the same project are often 
thinking about the same basic structures, but in different terms. They are most effective when 
they can chunk the basic structures as they see fit. 

A person who studies a supply chain in terms of the function played by each chain member 
should be able to converse coherently with a person who studies the same supply chain in terms 
of the contracts and negotiations that exist at each chain link. These are two radically different 
viewpoints on the same system, and it is useful to be able to switch fluidly between them. 
Similarly, an engineer designing a system’s hardware must be able to converse with an engineer 
working on the system’s software. Otherwise, small perturbations made by one of them will be 
unexpected by the other, and this can lead to major problems. 

The same types of issues emerge whether one is concerned with manufacturers in a supply 
chain, neurons in a functional brain region, modules in a computer program, or steps in a recipe. 
In each case, what we call propagators (after [RS]) are being arranged into a system that is 
itself a propagator at a higher level. The goal of this paper is to provide a mathematical basis 
for thinking about this kind of problem. We offer a formalism that describes the hierarchical 
and self-similar nature of a certain kind of wiring diagram. 

A similar kind of wiring diagram was described in [Sp2], the main difference being that 
the present one is built for time-based processes whereas the one in |Sp2] was built for static 
relations. In the present work we take the notion of time (or one may say distance) seriously. We 
go through considerable effort to integrate a notion of time and distance into the fundamental 
architecture of our description, by emphasizing that communication channels have a length, i.e. 
that communication takes time. 

Design choices such as these greatly affect the behavior of our model, and ours was certainly 
not the only viable choice. We hope that the basic idea we propose will be a basis upon which 
future engineers and mathematicians will improve. For the time being, we may at least say that 
the set of rules we propose for our wiring diagrams roughly conform with the IDEFO standard 
set by the National Institute of Standards and Technology [NIST]. The main differences are 
that in our formalism, 


• wires can split but not merge (each merging must occur within a particular box), 

• feedback loops are allowed, 

• the so-called control and mechanism arrows are subsumed into input and output arrows, 
and 

• the rules for and meaning of hierarchical composition is made explicit. 
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The basic picture to have in mind for our wiring diagrams is the following: 


flour 

sugar 

salt 

milk 



■ cookie batter 
• egg yolks 


( 1 ) 

In this picture we see an exterior box, some interior boxes, and a collection of directed wires. 
These directed wires transport some type of product from the export region of some box to the 
import region of some box. In (1) we have a supply chain involving three propagators, one of 
whom imports flour, sugar, and salt and exports dry mixture, and another of whom imports 
eggs and milk and exports egg yolks and wet mixture. The dry mixture and the wet mixture 
are then transported to a third propagator who exports cookie batter. The whole system itself 
constitutes a propagator that takes five ingredients and produces cookie batter and egg yolks. 

The formalism we offer in this paper is based on a mathematical structure called an operad 
(more precisely, a symmetric colored operad ), chosen because they capture the self-similar nature 
of wiring diagrams. The rough idea is that if we have a wiring diagram and we insert wiring 
diagrams into each of its interior boxes, the result is a new wiring diagram. 




(2) 

We will make explicit what constitutes a box, what constitutes a wiring diagram (WD), and 
how inserting WDs into a WD constitutes a new WD. Like Russian dolls, we may have a nesting 
of WDs inside of WDs inside of WDs, etc. We will prove an associativity law that guarantees 
that no matter how deeply our Russian dolls are nested, the resulting WD is well-defined. Once 
all this is done, we will have an operad W. 

To make this directed wiring diagrams operad W useful, we will take our formalism to the 
next logical step and provide an algebra on W. This algebra V encodes our application to 
process management by telling us what fits in the boxes and how to use wiring diagrams to 
build more complex systems out of simpler components. More precisely, the algebra V makes 
explicit 

• the set of things that can go in every box, namely the set of propagators, and 

• a method for taking a wiring diagram and a propagator for each of its interior boxes 
and producing a propagator for the exterior box. 

To prove that we have an algebra, we will show that no matter how one decides to group the 
various internal propagators, the behavior of the resulting system is unchanged. 

Operads were invented in the 1970s by [May] and [ ] in order to encode the relationship 

between various operations they noticed taking place in the mathematical field of algebraic 
topology. At the moment we are unconcerned with topological properties of our operads, but 
the formalism grounds the picture we are trying to get across. For more on operads, see [Lei]. 
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1.1. Structure of the paper. In Section 2 we discuss operads. In Section 2.1 we give the 
mathematical definition of operads and some examples. In Section 2.2 we propose the operad 
of interest, namely W, the operad of directed wiring diagrams. We offer an example wiring 
diagram in Section 2.3 that will run throughout the paper and eventually output the Fibonacci 
sequence. In Section 2.4 we prove that W has the required properties so that it is indeed an 
operad. 

In Section 3 we discuss algebras on an operad. In Section 3.1 we give the mathematical 
definition of algebras. In Sections 3.2 we discuss some preliminaries on lists and define our 
notion of historical propagators, which we will then use in 3.3 where we propose the W-algebra of 
interest, the algebra of propagators. In Section 3.5 we prove that V has the required properties 
so that it is indeed a W-algebra. 

We expect the majority of readers to be most interested in the running examples sections, 
Sections 2.3 and 3.4. Readers who want more details, e.g. those who may wish to write code 
for propagators, will need to read Sections 2.2, 3.3. The proof that our algebra satisfies the 
necessary requirements is technical; we expect only the most dedicated readers to get through 
it. Finally, in Section 4 we discuss some possibilities for future work in this area. 

The remainder of the present section is devoted to our notational conventions (Section 1.2) 
and our acknowledgments (1.3). 

1.2. Notation and background. Here we describe our notational conventions. These are 
only necessary for readers who want a deep understanding of the underlying mathematics. Such 
readers are assumed to know some basic category theory. For mathematicians we recommend 
[Awo] or [Mac], for computer scientists we recommend [Awo] or [BW], and for a general audience 
we recommend [Spl]. 

We will primarily be concerned only with the category of small sets, which we denote by Set, 
and some related categories. We denote by Fin C Set the full subcategory spanned by finite 
sets. We often use the symbol n G Ob(Fin) to denote a finite set, and may speak of elements 
i G n. The cardinality of a finite set is a natural number, denoted |n| G N. In particular, we 
consider 0 to be a natural number. 

Suppose given a finite set n and a function X: n —> Ob(Set), and let M ieI X(i) be the 
disjoint union. Then there is a canonical function nx- Hj £n X(i) —► n which we call the 
component projection. We use almost the same symbol in a different context; namely, for any 
function s: m->nwe denote the s-coordinates projection by 

tt,: n*wn *<•«>)• 

ien jem 

In particular, if i G n is an element, we consider it as a function i: {*} —>• n and write 
7T,: X(i) —> X(i) for the usual ith coordinate projection. 

A pointed set is a pair (S, s ) where S G Ob(Set) is a set and s G S' is a chosen element, called 
the base point. In particular a pointed set cannot be empty. Given another pointed set (T, t), 
a pointed function from (S, s ) to ( T , t) consists of a function f-.S—t-T such that /(s) = t. We 
denote the category of pointed sets by Set*. There is a forgetful functor Set* —y Set which 
forgets the basepoint; it has a left adjoint which adjoins a free basepoint IgIH {*}. We 
often find it convenient not to mention basepoints; if we speak of a set X as though it is pointed, 
we are actually speaking of X H {*}. If S, S' are pointed sets then the product S x S' is also 
naturally pointed, with basepoint (*,*), again denoted simply by *. 

We often speak of functions n —> Ob(Set*), where n is a finite set. Of course, Ob(Set*) 
is not itself a small set, but using the theory of Grothendieck universes [Bou], this is not a 
problem. It will be even less of a problem in applications. 
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2. W, THE OPERAD OF DIRECTED WIRING DIAGRAMS 

In this section we will define the operad W of black boxes and directed wiring diagrams 
(WDs). It governs the forms that a black box can take, the rules that a WD must follow, and 
the formula for how the substitution of WDs into a WD yields a WD. There is no bound on 
the depth to which wiring diagrams can be nested. That is, we prove an associative law which 
roughly says that the substitution formula is well-defined for any degree of nesting, shallow or 
deep. 

We will use the operad W to discuss the hierarchical nature of processes. Each box in our 
operad will be filled with a process, and each wiring diagram will effectively build a complex 
process out of simpler ones. However, this is not strictly a matter of the operad W but of an 
algebra on W. This algebra will be discussed in Section 3. 

The present section is organized as follows. First, in Section 2.1 we give the technical 
definition of the term operad and a few examples. In Section 2.2 we propose our operad 
W of wiring diagrams. It will include drawings that should clarify the matter. In Section 
2.3 we present an example that will run throughout the paper and end up producing the 
Fibonacci sequence. This section is recommended especially to the more category-theoretically 
shy reader. Finally, in Section 2.4 we give a technical proof that our proposal for W satisfies 
the requirements for being a true operad, i.e. we establish the well-definedness of repeated 
substitution as discussed above. 

2.1. Definition and basic examples of operads. Before we begin, we should give a warning 
about our use of the term “operad”. 

Warning 2.1.1. Throughout this paper, we use the word operad to mean what is generally called 
a symmetric colored operad or a symmetric multicategory. This abbreviated nomenclature is 
not new, for example it is used in [Lur] . Hopefully no confusion will arise. For a full treatment 
of operads, multicategories, and how they fit into a larger mathematical context, see [Lei]. 

Most of Section 2.1 is recycled material, taken almost verbatim from [Sp2]. We repeat it 
here for the convenience of the reader. 

Definition 2.1.2. An operad O is defined as follows: One announces some constituents (A. 
objects, B. morphisms, C. identities, D. compositions) and proves that they satisfy some re¬ 
quirements (1. identity law, 2. associativity law). Specifically, 

A. one announces a collection Ob(0), each element of which is called an object of O. 

B. for each object y £ Ob(O), finite set n £ Ob(Fin), and n-indexed set of objects 
x: n —>• Ob(0), one announces a set O n (x: y) £ Ob(Set). Its elements are called 
morphisms from x to y in O. 

C. for every object x £ Ob(0), one announces a specified morphism denoted kfy e 
0\ (x\ x) called the identity morphism on x. 

D. Let s : m — y n be a morphism in Fin. Let 2: e Ob((9) be an object, let y: n — > Ob(0) 
be an n-indexed set of objects, and let x: m —>• Ob(0) be an m-indexed set of objects. 
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For each element i £ n, write to, := s 1 (i) for the pre-image of s under i, and write 
Xi = x | m .: rrii —> Ob(O) for the restriction of x to rn t . Then one announces a function 


(3) o: O n (y-,z ) —> O m (x-,z), 

ien 

called the composition formula for O. 

Given an n-indexed set of objects x: n —t Ob(O) and an object y £ Qb(O), we sometimes abuse 
notation and denote the set of morphisms from x to y by 0(x\,... ,x n \y). 1 We may write 
Homo(xi,..., x n \ y), in place of 0(x i,..., x n \ y), when convenient. We can denote a morphism 
<j) £ O n {x\ y) by 0: x —» y or by <j>: (aq,..., x n ) —> y, we say that each is a domain object of 
(f> and that y is the codomain object of 4>. We use infix notation for the composition formula, 
e.g. writing if o fyq,..., <f> n ). 

These constituents (A,B,C,D) must satisfy the following requirements: 

1. for every aq,..., x n , y £ 0b((9) and every morphism 6: (aq,..., x n ) —> y, we have 

(f o (id Xl ,..., id Xn ) = (f and kfy o 0 = 0; 

2. Let to A n —> p be composable morphisms in Fin. Let z £ Ob(O) be an object, 

let y: p —> Ob(O), x: n —> Ob(O), and w: to —► Ob(£>) respectively be a p-indexed, 
n-indexed, and m-indexed set of objects. For each i £ p, write n, = ir 1 (i) for the 
pre-image and Xi \ —> Ob(O) for the restriction. Similarly, for each k £ n write 

TO*, = s~ 1 (k) and in*,: m*, —> Ob(O); for each i £ p, write to^- = (to s) _1 (j) and 
Wi-: mi - Ob(C>); for each j £ n», write := s _1 (i) and UHj- m i,j Ob(O). 

Then the diagram below commutes: 


O p (w,z) X n i&Ontfay®) x Iliep, ien, O^Jw^XiU)) 

On(x;z) X n ken Orn k (w k :x(k)) O p (y;z)xU iep O mi Jw ii -iy(t)) 

O m (w;z) 


Remark 2.1.3. In this remark we will discuss the abuse of notation in Definition 2.1.2 and 
how it relates to an action of a symmetric group on each morphism set in our definition of 
operad. We follow the notation of Definition 2.1.2, especially following the use of subscripts in 
the composition formula. 

Suppose that O is an operad, z £ Ob(0) is an object, y: n —t Ob(O) is an n-indexed 
set of objects, and cf>\ y —f z is a morphism. If we linearly order n, enabling us to write 
(f: (y(l),..., y(\n\)) —> z, then changing the linear ordering amounts to finding an isomorphism 
of finite sets a: to A n, where |m| = |n|. Let x = y o a and for each i £ n, note that 
nij = cr -1 ({f}) = {cr —1 (i)}, so Xi = jcfy-i(j) = y(i). Taking id Xi e O mi {xi\y{i)) for each 
i £ n, and using the identity law, we find that the composition formula induces a bijection 
O n (y\ z) O m (x: z ), which we might denote by 

cr: 0(y(l),y(2 ),..., y(n); z) = O(y{o{\)),y{a{2 )),..., y(<r(n)); z). 


^^There are three abuses of notation when writing 0(xi,... ,x n ; y), which we will fix one by one. First, it 
confuses the set n 6 Ob(Fin) with its cardinality |n| £N. But rather than writing 0(x i,..., x|„|; y), it would 
be more consistent to write 0(x( 1),..., x(\n\); y), because we have assigned subscripts another meaning in D. 
However, even this notation unfoundedly suggests that the set n has been endowed with a linear ordering, which 
it has not. This may be seen as a more serious abuse, but see Remark 2.1.3. 
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In other words, there is an induced group action of Aut(n) on O n (y(l),... ,y(n); z), where 
Aut(n) is the group of permutations of an n-element set. 

Throughout this paper, we will permit ourselves to abuse notation and speak of morphisms 
0: ( Xi,X2 , ■ ■ ■ • x n ) —y y for a natural number n £ N, without mentioning the abuse inherent in 
choosing an order, so long as it is clear that permuting the order of indices would not change 
anything up to canonical isomorphism. 

Example 2.1.4. We define the operad of sets, denoted Sets, as follows. We put Ob(Sets) := 
Ob(Set). Given a natural number n £ N and objects Xi ,..., X n , Y £ Ob(Sets), we define 
Sets(Xi, X 2 ,..., X n : Y) :=Hom Se t(Xi x X 2 x • • • x X n ,Y). 

For any X £ Ob(Sets) the identity morphism idx : X —> X is the same identity as that in Set. 

The composition formula is as follows. Suppose given a set Z £ Ob(Set), a finite set 
n £ Ob(Fin), for each i £ n a set Y i: £ Ob(Set) and a finite set rrij £ Ob(Fin), and for each 
j £ a set X,j £ Ob(Set). Suppose furthermore that we have composable morphisms: a 
function g: Y\ ien Y t -» Z and for each i £ n a function /j: Xij Y.,. Let m = fifim,;. 

We need a function || . gm X 7 —> Z. which we take to be the composite 

nn-L, J1 Aun^2. 

iEnjenn ien 

It is not hard to see that this composition formula is associative. 

Example 2.1.5. The commutative operad £ has one object, say Ob(£) = {a}, and for each n £ N 
it has a single n-ary morphism, £„(a, ..., a; a) = {/x n }. 

2.2. The announced structure of the wiring diagrams operad W. To define our operad 
W, we need to announce its structure, i.e. 

• define what constitutes an object of W, 

• define what constitutes a morphism of W, 

• define the identity morphisms in W, and 

• the formula for composing morphisms of kV. 

For each of these we will first draw and describe a picture to have in mind, then give a 
mathematical definition. In Section 2.4 we will prove that the announced structure has the 
required properties. 


Objects are black boxes. Each object X will be drawn as a box with input arrows entering on 
the left of the box and output arrows leaving from the right of the box. The arrows will be 
called wires. All input and output wires will be drawn across the corresponding vertical wall 
of the box. 


(4) 



out(X) 


Each wire is also assigned a set of values that it can carry, and this set can be written next to 
the wire, or the wires may be color coded. See Example 2.2.2 below. As above, we often leave 
off the values assignment in pictures for readability reasons. 


Announcement 2.2.1 (Objects of kV). An object X £ Ob(W) is called a black box , or box 
for short. It consists of a tuple X := (in(X), out (A), vset), where 

• in(X) £ Ob(Fin) is a finite set, called the set of input wires to X, 

• out(X) £ Ob(Fin) is a finite set, called the set of output wires from X, and 
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• vset(A) : in(X) Hout(X) —> Ob (Set,) is a function, called the values assignment for 
X. For each wire i £ in(X) II out(X), we call vset(i) £ Ob(Set*) the set of values 
assigned to wire i, and we call its basepoint element the default value on wire i. 

0 


Example 2.2.2. We may take X = ({l},{2,3},vset), where vset: {1,2,3} -A Ob(Set*) is 
given by vset(l) = N, vset(2) = N, and vset(3) = {a, b, c}. 2 We would draw X as follows. 

{a, b, c} 

N 


The input wire carries natural numbers, as does one of the output wires, and the other 
output wire carries letters a, b, c. 

Morphisms are directed wiring diagrams. Given black boxes Yi,... ,Y n £ Ob(>V) and a black 
box Z £ Ob(W), we must define the set W n (Y ; Z) of wiring diagrams (WDs) of type Y\,... ,Y n — 
Z. Such a wiring diagram can be taken to denote a way to wire black boxes Yi,..., Y n together 
to form a larger black box Z. A typical such wiring diagram is shown below: 

i>: (Y l ,Y 2 ,Y 3 )^Z 


in (Z) 


( 5 ) 

Here n = 3, and for example Y| has two input wire and three outputs wires. Each wire in a 
WD has a specified directionality. As it travels a given wire may split into separate wires, but 
separate wires cannot come together. The wiring diagram also includes a finite set of delay 
nodes; in the above case there are four. 

One should think of a wiring diagram if: Yi ,..., Y n —l Z as a rule for managing material (or 
information) flow between the components of an organization. Think of ip as representing this 
organization. The individual components of the organization are the interior black boxes (the 
domain objects of if) and the exterior black box (the codomain object of ip). Each component 
supplies material to ip as well as demands material from ip. For example component Z supplies 
material on the left side of ip and demands it on the right side of ip. On the other hand, each Y) 
supplies material on its right side and demands material on its left. Like the IDEFO standard 
for functional modeling diagrams [NIST], we always adhere to this direct ionality. 

We insist on one perhaps surprising (though seemingly necessary rule), namely that the 
wiring diagram cannot connect an output wire of Z directly to an input wire of Z. Instead, 
each output wire of Z is supplied either by an output wire of some Y (i) or by a delay node. 


2 The functor vset is supposed to assign pointed sets to each wire, but no base points are specified in the 
description above. As discussed in Section 1.2, in this case we really have vset(l) = Nil {*}, vset(2) = Nil {*}, 
and vset(3) = {a, b, c} II {*}, where * is the default value. 
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Announcement 2.2.3 (Morphisms of W). Let n £ Ob(Fin) be a finite set, let Y: n -¥ Ob(W) 
be an n-indexed set of black boxes, and let Z £ Ob(W) be another black box. We write 

(6) in(F)=n ie „in(y(i)), 

out(r) = ii ien out(y(i)). 

We take vset: in(y) II out(y) —> Ob(Set*) to be the induced map. 

A morphism 

ip: y(l),...,y(n) 

in W n (y; Z) is called a temporal wiring diagram, a wiring diagram, or a WD for short. It 
consists of a tuple ( DN vset, sgf) as follows. 3 

• DN^ £ Ob(Fin) is a finite set, called the set of delay nodes for ip. At this point we 
can define the following sets: 

Drriy : := out(Z) II in(y) II DNg, the set of demand wires in ip, and 

Sp^ := in (Z) II out(y) II DN$ the set of supply wires in ip. 

• vset: ON,/, —> Ob(Set) is a function, called the value-set assignment for ip, such that 
the diagram 


DN^ - 1 Dmq, 



SPi/> -h Set* 


commutes (meaning that every delay node demands the same value-set that it supplies). 
• s,j,: Dm^ —>■ Sp,j : is a function, called the supplier assignment for ip. The supplier 
assignment s,/, must satisfy two requirements: 

(1) The following diagram commutes: 

Dm^ 


Spg, ■ v3et > Set* 

meaning that whenever a demand wire is assigned a supplier, the set of values 
assigned to these wires must be the same. 

(2) If z £ out (Z) then s^(z) <t in (Z). Said another way, 

«i/>]out(z) C out(y) II DNj/j, 

meaning that a global output cannot be directly supplied by a global input. We 
call this the non-instantaneity requirement. 

We have functions vset: in (Z) II out (Z) — ► Set*, vset: in(y(i)) Hout(y(i)) — > Set*, and 
vset: DN,j, —>• Set*. It should not cause confusion if we use the same symbol to denote the 
induced functions vset: Dm^ —> Set* and vset: Sp,j, —> Set*. 


morphism iji: Y —> Z is in fact an isomorphism class of this data. That is, given two tuples (DN^, vset, s j,) 
and (DN^, vset', s'^) as above, with a bijection DN V = DN^ making all the appropriate diagrams commute, 
we consider these two tuples to constitute the same morphism if>: Y —>■ Z. 
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Remark 2.2.4. We have taken the perspective that W is an operad. One might more naturally 
think of W as the underlying operad of a symmetric monoidal category whose objects are again 
black boxes and whose morphisms are again wiring diagrams, though now a morphism connects 
a single internal domain black box to the external codomain black box. From this perspective 
one should merge the many isolated black boxes occurring in the domain of a multicategory 
wiring diagram into a single black box as the domain of the monoidal category wiring diagram. 

Though mathematically equivalent and though we make use of this perspective in the course 
of our proofs, it is somewhat unnatural to perform this grouping in applications. For example, 
though it makes some sense to view ourselves writing this paper and you reading this paper as 
black boxes inside a single “information conveying” wiring diagram it would be rather strange 
to conglomerate all of our collective inputs and outputs so that we become a single meta¬ 
information entity. For reasons of this sort we choose to take the perspective of the underlying 
operad rather than of a monoidal category. 

On the other hand, the notation of monoidal categories is convenient, so we introduce it 
here. Given a finite set n and an n-indexed set of objects Y: n —>■ Ob(W), we discussed in (6) 
what should be seen as a tensor product 

(g)F(i) = (IIj en in(Y (*)), IIj e „out(Y (*)), vset), 

i£n 

which we write simply as Y = (in(Y), out(Y), vset). 

Similarly, given an n-indexed set of morphisms fa". X% —► Y (i) in W, we can form their 
tensor product 

iEn i£n iEn 

which we write simply as (f): X —► Y, in a similar way. That is, we form a set of delay nodes 
DN 0 = IIsupplies Sp$ = IIj e „S'p^., demands Dm$ = U^Dm ^., and a supplier 
assignment s</, = H^s^, all by taking the obvious disjoint unions. 

Example 2.2.5. In the example below, we see a big box with three little boxes inside, and 
we see many wires with arrowheads placed throughout. It is a picture of a wiring diagram 
</>: (X-i , X-2: X 3 ) —> Y. The big box can be viewed as Y, which has some number of input and 
output wires; however, when we see the big box as a container of the little boxes wired together, 
we are actually seeing the morphism <j>. 

cj,: (X 1 ,X 2 ,X 3 )->Y 

flour 
sugar 
salt 
milk 
eggs 


We aim to explain our terminology of demand and supply, terms which interpret the organi¬ 
zation forced on us by the mathematics. Each wire has a demand side and a supply side; when 
there are no feedback loops, as in the picture above, supplies are on the left side of the wire 
and demands are to the right, but this is not always the case. Instead, the distinction to make 
is whether an arrowhead is entering the big box or leaving it: those that enter the big box are 
supplies to <j>, and those that are leaving the big box are demands upon <j>. The five left-most 
arrowheads are entering the big box, so flour, sugar, etc. are being supplied. But flour, sugar, 



" cookie batter 
• egg yolks 
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and salt are demands when they leave the big box to enter X±. Counting, one finds 9 supply 
wires and 9 demand wires (though the equality of these numbers is just a coincidence due to 
the fact that no wire splits or is wasted). 

Identity morphisms are identity supplier assignments. Let Z = (in(Z), out(Z), vset). The 
identity wiring diagram id z : Z —» Z might be drawn like this: 


Z 



Even though the interior box is of a different size than the exterior box, the way they are wired 
together is as straightforward as possible. 

Announcement 2.2.6 (Identity morphisms in W). Let Z = (in(Z), ont(Z), vsetz). The 
identity wiring diagram idz : Z —» Z has DN idz = 0 with the unique function vset: 0 —» 
Ob(Set), so that Dm idz = out(Z) II in (Z) and Sp idz = in (Z) II out (Z). The supplier 
assignment Sid z : .S'pid z —> Om 1( ] z is given by the identity function, which satisfies the non- 
instantaneity requirement. 

0 

Composition of morphisms is achieved by removing intermediary boxes and associated arrow¬ 
heads. We are interested in substituting a wiring diagram into each black box of a wiring 
diagram, to produce a more detailed wiring diagram. The basic picture to have in mind is the 
following: 
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On the top we see a wiring diagram ip in which each internal box, say Y (1) and Y (2), has 
a corresponding wiring diagram <p-\ and <t>2 respectively. Dropping them into place and then 
removing the intermediary boxes leaves a single wiring diagram uj. One can see that every 
input of Y{i) plays a dual role. Indeed, it is a demand from the perspective of ip, and it is a 
supply from the perspective of < pi. Similarly, every output of Y(i) plays a dual role as supply 
in ip and demand in (pi. 

In Announcement 2.2.8 we will provide the composition formula for W. Namely, we will be 
given morphisms (pi: JQ —► Y ( i ) and ip: Y —>• Z. Each of these has its own delay nodes, DN ^ 
and DNq, as well as its own supplier assignments. Write (p = (pi: X —> Y as in Remark 
2.2.4. For the reader’s convenience, we now summarize the demands and supplies for each of the 
given morphisms fa: Xi —> Y(i) and ip: Y —> Z, as well as their (not-yet defined) composition 
w: X -> Z. Let DN U = DN 0 II DN.\p. 


Summary of notation for composition in W 

Morphism 

Dm- 

Sp- 

(pi 

out(y(*)) n in(Wi) n dn^ 

in(y(*)) n out(Wi) n dn^ 


out(y) II in(W) II DNq 

in(y) II out(A’) II DN# 

# 

out (z) n in(y) n dn^ 

in(Z) II out(y) II DNy, 

U) 

out(Z) II in(W) II DN U 

in(Z) II out(W) II DN U 


Lemma 2.2.7. Suppose given morphisms X 4 7 and Y Z in W, as above. That is, we 
are given sets of delay nodes, DN,p and DN,j,, as well as supplier assignments 

s$: Dm$ —> Sp$ and sq, : Dm^ —> Sp$ 

each of which is subject to a non-instantaneity requirement, 

(8) ^| ort(r) Qaat(X)UDN t and ^L t(z) C out(F) II DN+. 

Let s u be as in Table 7. It follows that the diagram below is a pushout 

Sp 0 - > Sp u 

\ 

in(y) n out(^;s— ->■ Sp, p 

where 

(9) e = | II id out (y) 

/ = idin(Z) II S <?i| out (y) Jd id£)AT^, 

9 = idin(Y) n S</ 1 | out( y ) 

h= (/ ° sg,) I ln ^ II id out (x) II id dn$ ■ 

Moreover, each of e,f,g, and h commute with the appropriate functions vset. 

Proof. We first show that the diagram commutes; here are the calculations on each component: 

•^° e lin(Y) = f° S An(Y) = ^°S'li n(V) 
f ° e lout(V) = S ^lout(Y) = ^ ° flloul^Y)- 
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We now show that the diagram is a pushout. Suppose given a set Q and a commutative 
solid-arrow diagram (i.e. with h! o g = f o e): 



in(Y) II out(Y)--->■ in (Z) II out(Y) II DNp 


Looking at components on which / and h are identities, we see that if we want the equations 
ao f = f and a o h = h' to hold, there is at most one way to define a: Sp u Q. Namely, 

a:= f lin(Z)ILDIV,/, lout(X)H.DIV 

To see that this definition works, it remains to check that a o f\ 0Ut ^ Y ^ = / 7 | out (>-) and that 
a o h \= h'\ in ^ Y y For the first we use a non-instantaneity requirement (8) to calculate: 


a ° ^Lut(y) = a ° S <f>Lut(V) = a lout(X)IIDIV* ° S ^lout(V) 

= ti O 

= ° out(F) = f° e lout(V) = ^lout(V) 

Now we have shown that ao f = f and the second calculation follows: 

a ° ^lin(y) = ao f ° = f ° S ^lisfe{y) = / ° e lin(V) = ^ °S , | in (y) = ^ | in (y) 

Each of e, /, g, h commute with the respective functions vset because each is built solely out 
of identity functions and supplier assignments. This completes the proof. 


□ 


Announcement 2.2.8 (Composition formula for W). Let m,n € Ob(Fin) be finite sets and 
let t: m —» n be a function. Let Z G Ob(W) be a black box, let Y : n —t Ob(0) be an n-indexed 
set of black boxes, and let X: m —>■ Ob(O) be an m-indexed set of black boxes. For each element 
i € n, write to, := for the pre-image of i under t, and write Xi = X\ m : mi —» Ob((9) 

for the restriction of X to m*. Then the composition formula 

o: W n (Y; Z)x]J W TOi (X i; Y(*)) —► W m {X- Z), 

ien 

is defined as follows. 

Suppose that we are given morphisms (f>i : Xi — > Y(i) for each i £ n, which we gather into 
a morphism (j> = (££),. </>,*: X —> Y as in Remark 2.2.4, and that we are also given a morphism 

Y —> Z. Then we have finite sets of delay nodes DNp and DNp, and supplier assignments 
sp : Dm$ —> Spp and sp : Dm^ —> Spp 

as in Announcement 2.2.3. 

We are tasked with defining a morphism io := $ © <fi: X —> Z. The set of demand wires and 
supply wires for w are given in Table (7). Thus our job is to define a set DN U and a supplier 
assignment s w : Dm u —y Sp 

We put DN U = DNp II DN.p. It suffices to find a function 

: out(Z) E in(X) II DN U —> in (Z) II out(X) II DN U , 
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which satisfies the two requirements of being a supplier assignment. We first define the function 
by making use of the following diagram, where the pushout is as in Lemma 2.2.7: 


( 10 ) 


in(A) II DNtj, 


-ffjj|P--- Sp u 



in (Y) II outer) ^-- % 


out(Z) II DN i; 


Thus we can define a function 

(- 1 - 1 ) s u = ho S0| in ( X ) nDJVi#i n / o Sip | mt ( Z )n£>iv v ,' 

We need to show that s u satisfies the two requirements of being a supplier assignment (see 
Announcement 2.2.3). 

(1) The fact that s u commutes with the appropriate functions vset follows from the fact 

that and h do so (by Lemma 2.2.7). 

(2) The fact that the non-instantaneity requirement holds for s u , i.e. that s w (out(Z)) C 
out (A) II DN U , follows from the fact that it holds for and s,/, (see (8)), as follows. 

s u (out(Z)) = f o s^out(Z)) 

C /(out(y) II DN^) 

= s^(out(r)) II DN$ 

C out (A) n DN+ n DN^ = out (A) II DN U . 


0 

2.3. Running example to ground ideas and notation regarding W. In this section we 
will discuss a few objects of W (i.e. black boxes), a couple morphisms of W (i.e. wiring 
diagrams), and a composition of morphisms. We showed objects and morphisms in more 
generality above (see Examples 2.2.2 and 2.2.5). Here we concentrate on a simple case, which 
we will take up again in Section 3.4 and which will eventually result in a propagator that 
outputs the Fibonacci sequence. First, we draw three objects, A ,Y,Z £ Ob(VV). 


( 12 ) 




cz 


These objects are not complete until the pointed sets associated to each wire are specified. Let 
N := (N, 1) be the set of natural numbers with basepoint 1, and put 

vset(ax) = vset (bx) = vset(cx) = vset (ay) = vset(cy) = vset(cz) = N. 
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Now we draw two morphisms, i.e. wiring diagrams, (p: X —> Y and ip: Y —> Z: 




(13) 

To clarify the notion of inputs, outputs, supplies, and demands, we provide two tables that lay 
out those sets in the case of (13). 


Objects shown above 

Object 

in(—) 

out (—) 

X 

{a x ,b x } 

{cx} 

Y 

{ay} 

M 

Z 

{} 

{cz} 


Morphisms shown above 

Morphism 

DN 

Dm- 

Sp- 

<t> 

{} 

{c Y ,a x ,bx} 

{ay, c x } 

# 

{dp} 

{cz,ay,dp} 

{cy,dp} 


To specify the morphism <p: X - 
provide a set of delay nodes DNp, 


> Y (respectively ip: Y ->■ Z), we are required not only to 
, which we said was DNp = 0 (respectively, DN'p = {dp}), 
but also a supplier assignment function sp: Dmp —> Spp (resp., sp: Drrip —y Spp). Looking at 
the picture of <p (resp. ip) above, the reader can trace backward to see how every demand wire 
is attached to some supply wire. Thus, the supplier assignment sp for (p: X —> Y is 

cy H- c x , a x H- ay, b x i-t c x , 

and the supplier assignment Sp for ip: Y —> Z is 

Cz i dp, ay i—> dp, dp i—> Cy- 

We now move on to the composition of ip and (p. The idea is that we “plug the <i> diagram 
into the Y -box of the ip diagram, then erase the Y-box”. We follow this in two steps below: on 
the left, we shrink down a copy of (p and fit it into the Y-box of ip. On the right, we erase the 
Y-box: 



The pushout (10) ensures that wires of Y connect wires inside (i.e. from (p ) to wires outside 
(i.e. from ip). In other words, when we erase box Y, we do not erase the connections it made 
for us. We compute the pushout of the diagram 


{ay,cx}* 


- {ay,cy } - 


> {cy, dp}, 














































DYLAN RUPEL AND DAVID I. SPIVAK 


defining Sp u , to be isomorphic to {d,ij, cx}- The supplier assignment s u : Dm u = {cz, ax, bx,d—> 
{dry-cz} = Sp u is given by 

(14) cz i—t d^, ax >—t d-i/i, l_ t <W, d^ i-> cx- 

We take this example up again in Section 3.4, where we show that installing a “plus” function 

into box X yields the Fibonacci sequence. 

2.4. Proof that the operad requirements are satisfied by W. We need to show that the 
announced operad W satisfies the requirements set out by Definition 2.1.2. There are two such 
requirements: the first says that composing with the identity morphism has no effect, and the 
second says that composition is associative. 

Proposition 2.4.1. The identity law holds for the announced structure ofW- 

Proof. Let X 1 ,..., X n and Y be black boxes and let <j>: X- t ,.... X n —> Y be a morphism. We 
need to show that the following equations hold: 

(j) o (id Xl ,..., id Xn ) = <j> and id y o (f> = <f>. 

We are given a set DN$ and a function vset: DN<p —> Ob(Set). Let idx = (££) ien idj^, and 
form in(X) and out(X) as in Remark 2.2.4. Thus we have 

Sp+ = in(F) II out (W) II DN* and Dm# = out (F) II in(X) II DN^ 

and a supplier assignment s$: Dm$ —> Sp For each i £ n we have Spi dx . = Dmi dx , , and the 
supplier assignments are the identity, so we have 

Sp idx = Dm idx = in(X) II out(X) 

The supplier assignment S\ dx is the identity function. Similarly, Sp ldY = Dm idY = in(F) II 
out(F), and the supplier assignment sj<i r is the identity function. 

Let oj = <p o (idx-i,..., idx n ) and lo' = idy o 0. Then the relevant pushouts become 

Mj,_, a 0 |in(X)mdl 

in(X)- s Pidx - Sp u 


in(X) II out(J|£)^—->- Sp 0 



out {Y)UDN 4 


in(X) H DN ^ X)UDN * Sp 0 - 


,n(F)nout(F) 




out(F) 
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The pushout of an isomorphism is an isomorphism so we have isomorphisms Spp = Sp u and 
Sp^ = Spcji. 4 In both the case of to and u/, one checks using (9) that the induced supplier 
assignments are also in agreement (up to isomorphism), s u = = s u >. 

□ 


Proposition 2.4.2. The associativity law holds for the announced structure of W. 

Proof Suppose we are given morphisms r: W —>■ X, <p: X —t Y and ip:Y —> Z. We must 
check that (ipo(p)o t = ip o ((por). With notation as in Lemma 2.2.7, pushout square defining 
4> o t and then ip o [cp o r) are these: 


Sp f - ^ SpffroT ^PdtOT ' ^Piiio (<por) 



in(X) II out(X) ° ^> Sp$ in(F) II out(F) Sp,p 

whereas the pushout square defining ip o (p and then (ipo cp) or are these: 


SP(p Spijio(j 



in(F) n out(F) ■ ej| > Sp* 


h^e, 4 T 

Spr&Wp -—— Sp^o^or 

I fipO<p,T 

in(X)IIout m-^+Spw 


One checks directly from the formulas (9) that e.,p 0 p tT = h^^ o e^ iT as functions in(X) II 
out(X) —> Spi^ocf,, and that OT = f<t>,r ° <70,0 as functions in(F) II out(F) —> Sp^or- 
We combine them into the following pushout diagram: 


h# T h^ 0 OT 

Sp T - ! -^ Sp q i OT --^ Sp^or 



in(X) n out (A")-— Spp - - ^ Sp^ot 

L j/*,* 

in(F) E out(F| - e -> ■ Sp* 


The pasting lemma for pushout squares ensures that the set labeled Sp^o^or is isomorphic to 
Sppo(0o T ) and to Sp^ 0 ^ 0T , so these are indeed isomorphic to each other. It is also easy to 
check using the formulas provided in (11) and (9) that the supplier assignments 

Dm^or = out (Z) II in(W) II DN T II DNp II DN^ —► Sp^ OT 


agree regardless of the order of composition. This proves the result. 


□ 


4 Note that a morphism (e.g. ui) in W are defined only up to isomorphism class of tuples (DN U , vset, s w ), 
Announcement 2.2.3. 
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3. V, THE ALGEBRA OF PROPAGATORS ON W 

In this section we will introduce our algebra of propagators on W. This is where form meets 
function: the form called “black box” is a placeholder for a propagator, i.e. a function, that 
carries input streams to output streams, and the form called “wiring diagram” is a placeholder 
for a circuit that links propagators together to form a larger propagator. 

To formalize these ideas we introduce the mathematical notion of operad algebra in Section 
3.1. In Section 3.2 we discuss some preliminaries on lists and streams, and define our notion 
of historical propagator. In Section 3.3 we announce our algebra of these propagators and in 
Section 3.4 we ground it in our running example. Finally in Section 3.5 we prove that the 
announced structure really satisfies the requirements of being an algebra. 

3.1. Definition and basic examples of algebras. In this section we give the formal defini¬ 
tion for algebras over an operad. 

Definition 3.1.1. Let O be an operad. An O-algebra, denoted F: O —> Sets, is defined as 
follows: One announces some constituents (A. map on objects, B. map on morphisms) and 
proves that they satisfy some requirements (1. identity law, 2. composition law). Specifically, 

A. one announces a function Ob(F): Ob(0) —» Ob(Sets). 

B. for each object y £ Ob(O), finite set n £ Ob(Fin), and n-indexed set of objects 
x: n —> Ob(0), one announces a function 

F n : O n (x; y ) -> Hom Sets (Fz; Fy). 

As in B. above, we often denote Ob(F), and also each F n , simply by F. 

These constituents (A,B) must satisfy the following requirements: 

1. For each object x £ Ob(0), the equation F(id x ) = id f x holds. 

2. Let s: m n be a morphism in Fin. Let z £ Ob(O) be an object, let y: n —>■ Ob((9) 
be an n-indexed set of objects, and let a:: rn —>■ Ob(0) be an m-indexed set of objects. 
Then, with notation as in Definition 2.1.2, the following diagram of sets commutes: 

(15) O n (y,z) xn ie „CW*i;t/(i))-°- ~Om(x;s) 



Homgets (Fy; Fz) X n,: e „ Homsets^a;,; Fy(i)) —Hom Se ts(Fx; Fz) 

Example 3.1.2. Let £ be the commutative operad of Example 2.1.5. An £-algebra S: £ — > Sets 
consists of a set M £ Ob(Set), and for each natural number n £ N a morphism p n : M n —t 
M. It is not hard to see that, together, the morphism p 2 : M x M —> M and the element 
Mo : {*} —t Af give M the structure of a commutative monoid. Indeed, the associativity and 
unit axioms are encoded in the axioms for operads and their morphisms. The commutativity of 
multiplication arises by applying the commutative diagram (15) in the case s: {1,2} -»• {1,2} 
is the non-identity bijection, as discussed in Remark 2.1.3. 

3.2. Lists, streams, and historical propagators. In this section we discuss some back¬ 
ground on lists. We also develop our notion of historical propagator, which formalizes the idea 
that a machine’s output at time to can depend only on what has happened previously, i.e. for 
time t < to- While strictly not necessary for the development of this paper, we also discuss the 
relation of historical propagators to streams. 

Given a set S, an S-list is a pair (t,£), where i £ N is a natural number and £: {1,2,..., t} —> 
S is a function. We denote the set of S-lists by List (S'). We call t the length of the list; in 
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particular a list may be empty because we may have t = 0. Note that there is a canonical 
bijection 

List (5) = 

teN 

We sometimes denote a list simply by £ and write \£\ to denote its length; that is we have the 
component projection ]•]: List(A) -» N. We typically write-out an S-list as l = [£(1),£(2),... ,£(t)], 
where each £(i) e S. We denote the empty list by [ ]. Given a function /: S -> S', there is 
an induced function List(/): List(5) —> List(5') sending (t,£) to (t,f o £); in the parlance of 
computer science List(/) is the function that “maps / over £”. 

Given sets Xi,..., € Ob(Set), an element in List <i<fc Xf) is a list of fc-tuples. Given 

sets A and B there is a bijection 

Y : List (A) XNList(B) ——> List (A x B), 

where on the left we have formed the fiber product of the diagram List (A) -^N^- List(B). 
We call this bijection zipwith, following the terminology from modern functional programming 
languages. The idea is that an A-list l a can be combined with a B-list in, as long as they have 
the same length \£a\ = \£n[, the result will be an (A x B)-list l a Y in again of the same length. 
We will usually abuse this distinction and freely identify List (A x B) = List (A) x it List (B) with 
its image in List (A) x List(B). For example, we may consider the N x N-list 
[(1,2), (3,4), (5,6)] = [1,3,5] Y [2,4,6] 

as an element of List(N) x List(N). Hopefully this will not cause confusion. 

Let List>i(S') C List(S) denote the set H^iS*. We write List>i(S) —> List(5) to denote 
the function that drops off the last entry. More precisely, for any integer t > 1 if we consider £ 
as a function £: {1, 2,..., t} —» S, then the list dg£ is given by pre-composition with the subset 
consisting of the first t— 1 elements, 

{1,2,... ,Z — 1 } {1,2,...,t} 4 S. 

For example we have <9[0,1,4,9,16] = [0,1,4,9]. 

Definition 3.2.1. Let R, S be pointed sets and let n 6 N. A n-historical propagator f from R 
to S is a function /: List(B) —> List(5) satisfying the following conditions: 

(1) If a list £ e List(.R) has length \l\ = t, then |/(^)| =t + n, 

(2) If £ e List(i?) is a list of length t > 1, then 

d s m = w). 

We denote the set of n-historical propagators from R to S by Hist" (R, S). If / is n-historical 
for some n > 0 we say that / is historical. 

We usually drop the subscript from the symbol cL, writing e.g. df{£) = f(d£). 

Example 3.2.2. Let S' be a pointed set and let n G N be a natural number. Define an n-historical 
propagator § n e Hist"(S, S) as follows for £ e List(S): 


s n m) 



if 1 <i<n 
if n+l<i<t + n 


We call S n the n-moment delay function. For example if n = 3,S = {a,b,c,d} H {*}, and 
£= [a,a, 6, *,d] € S 5 then 6 3 (S ) = [*,*,*,a,a,b,*,d\ G S 8 . 


The following Lemma describes the behavior of historical functions. 
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Lemma 3.2.3. Let S, S', S",T,T' G Set* be pointed sets. 

(1) Let f:S—>Tbea function. The induced function List(/): List(S') —► List(T) is 
0 -historical. 

(2) Given n-historical propagators q G Hist" (S’, S’) and r G Hist"(T, T'), there is an induced 
n-historical propagator qx r G Hist” (S' x T, S' x T'). 

(3) Given q G Hist m (S, S') and q' G Hist"(S', S"), then (/ o q: List(S) —» List(S") is 
(m + n) -historical. 

(f) If n > 1 is an integer and q G Hist”(S, S') is n-historical then dq: List(S) —> List(S') 
is (n — 1)-historical. 

Proof. We show each in turn. 

(1) Let £ G List(S) be a list of length t. Clearly, List(/) sends £ to a list of length 
t. If t > 1 then the fact that <9List(/)(f) = List (/)(&£) follows by associativity of 
composition in Set. That is, List (/)(•£) is the right-hand composition and d£ is the 
left-hand composition below: 

{l,..., t - 1} {i,..., t} -4 s -4 t. 

(2) On the length t component we use the function (S x T)* = S' x T' qxr > S t+n x T t+n = 
(S x T) t+n . As necessary, we have 

d o {q x r) = dq x dr = qd x rd = (q x r) o d. 

(3) This is straightforward; for example the second condition is checked 

Oq'ml = q\dq{£)) = q'{q{d£)). 

(4) On lengths we indeed have \dq{£)\ = \q{£)\ — 1 = \£\ + n — 1. If \£\ = t > 1 then 
d(dq)(£) = d(dq(£)) = dq(d£) because q is historical. 

□ 

Definition 3.2.4. Let S be a pointed set. An S-stream is a function a: N>i —» S. We denote 
the set of 5-streams by Strm(5). 

For any natural number t G N, let ^ G List (S) denote the list of length t corresponding 
to the composite {1,2,..., <—> N>i S and call it the t-restriction of S. 

Lemma 3.2.5. Let S be a pointed set, let {*} be a pointed set with one element, and letn G N 
be a natural number. There is a bijection 

Hist”({*},5) AStrm(S). 

Proof. For any natural number t G N, let t = {1,2,..., t} G Ob(Set). Let [N] be the poset 
(considered as a category) with objects {t \ t G N}, ordered by inclusion of subsets. For any 
n G N there is a functor [N] -4 Set sending t G Ob([N]) to {1,2 ,... ,t + n} G Ob(Set). 

For any n G N, there is a bijection N = colim t6 [ N ]{l, 2,..., t + n}. Thus we have a bijection 
Strm(5) =Hom Se t(N>i,5) s lim Hom Set ({l, 2,..., f + n}, 5). 

te[N] 

On the other hand, an n-historical function /: List({*}) —> List(5) acts as follows. For each 
t G N and list [*,..., * t ] of length t, it assigns a list /([*,..., * t ]) G List(5) of length t + n, 
i.e. a function {1,..., t + «} -» S, such that /([*,..., *t_i]) is the restriction to the subset 
{1,... ,t + n - 1}. 

The fact that these notions agree follows from the construction of limits in the category Set. 
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Below we define an awkward-sounding notion of n-historical stream propagator. The idea is 
that a function carrying streams to streams is n-historical if, for all t £ N, its output up to time 
t + n depends only on its input up to time t. In Proposition 3.2.7 we show that this notion of 
historicality for streams is equivalent to the notion for lists given in Definition 3.2.1. 

Definition 3.2.6. Let S and T be pointed sets, and let n £ N be a natural number. A function 
/: Strm(S') —> Strm(T) is called an n-historical stream propagator if, given any natural number 
t £ N and any two streams a,a' £ Strm(S'), if er|j M j = cr')^ then f(a) = f( a ')\[ lt t+ n y 

Let Hist" trm (5, T) denote the set of n-historical stream propagators Strm(,S') —> Strm(T). 


Proposition 3.2.7. Let S and T be pointed sets. There is a bijection 
Hist™ ( S , T) 4 Hist™ rm (S , T). 


Proof. We construct two functions a: Hist™(S', T) —> Hist" trm (S l ,T) and 8 : Hist ™ trm (S,T) —> 
Hist™ (S, T) that are mutually inverse. 

Given an n-historical function /: List (S') —>• List(T) and a stream a £ Strm(S), define the 
stream a(f)(a): N>i — > T to be the function whose (t + n)-restriction (for any t, £ N) is given 

by 

a (/)( CT )|[M+n] =/H[M])- 

Because / is historical, this construction is well defined. 

Given an n-historical stream propagator F: Strm(S) —> Strm(T) and a list £ £ List(S) of 
length |£| = t, let 4 * £ Strm(S) denote the stream N>i — > S given on i £ N>i by 


4(i) = 


m 


if 1 < i < t 
if i > t + 1. 


Now define the list 8(F)(1) £ List(T) by 


8(F)(1) = F(Q | [M+n] . 

One checks directly that for all F £ Hist" tr . m (S, T) we have a o 8(F) = F and that for all 
/ e Hist" (5, T) we have 8 ° a(f) = f. 

□ 


The above work shows that the notion of historical propagator is the same whether one 
considers it as acting on lists or on streams. Throughout the rest of this paper we work solely 
with the list version. However, we sometimes say the word “stream” (e.g. “a propagator takes 
a stream of inputs and returns a stream of outputs”) for the image it evokes. 

3.3. The announced structure of the propagator algebra V. In this section we will 
announce the structure of our W-algebra of propagators, which we call V. That is, we must 
specify 

• the set V(Y) of allowable “fillers” for each black box Y £ Ob(W), 

• how a wiring diagram ip: Y 1 ,..., Y n —>■ Z and a filler for each fy serves to produce a 
filler for Z. 

In this section we will explain in words and then formally announce mathematical definitions. 
In Section 2.4 we will prove that the announced structure has the required properties. 

As mentioned above, the idea is that each black box is a placeholder for (i.e. can be filled 
with) those propagators which carry the specified local input streams to the specified local 
output streams. Each wiring diagram with propagators installed in each interior black box will 
constitute a new propagator for the exterior black box, which carries the specified global input 
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streams to the specified global output streams. We now go into more detail and make these 
ideas precise. 

Black boxes are filled by historical propagators. Let Z = out(Z), vset) be an object in 

W. Recall that each element w G in (Z) is called an input wire, which carries a set vset(w) 
of possible values, and that element w' G out (Z) is called an output wire, which also carries a 
set vset(«/) of possible values. This terminology is suggestive of a machine, which we call a 
historical propagator (or propagator for short), which takes a list of values on each input wire, 
processes it somehow, and emits a list of values on each output wire. The propagator’s output 
at time to can depend on the input it received for time t < to, but not on input that arrives 
later. 


Announcement 3.3.1 (V on objects). Let Z = (in(Z). out(Z), vset) be an object in W. For 
any subset I C in(Z) II out (Z) we define 

vset i = J^Jvset(i). 

iei 

In particular, if I = 0 then vset/ is a one-element set. 

We define V(Z) 6 Ob(Set) to be the set of 1-historical propagators of type Z, 

V(Z) := Hist 1 (vset ln( - Z ),vset out ( Z )). 


0 


Consider the propagator below, which has one input wire and one output wire, say both 
carrying integers. 


The name suggests that this propagator takes a list of integers and returns their running 
total. But for it to be 1-historical, its input up to time t determines its output up to time t + 1. 
Thus for example it might send an input list £ := [1,3, 5,7,10] of length 5 to the output fist 
“E”(£) = [0,1,4,9,16,26] of length 6. 

Remark 3.3.2. As in Remark 2.2.4 the following notation is convenient. Given a finite set 
n G Ob(Fin) and black boxes Y t G Ob(W) for i G n, we can form Y = 0 ign Y-i, with for 
example in(F) = II, £ „in(y' i ). Similarly, given a 1-historical propagator g t G V(Yf) for each 
iGnwe can form a 1-historical propagator g := 3,; G Hist 1 (vset in( -yj, vset 0Ut( - F j) simply 

by g = n ien 9i- 

Wiring diagrams shuttle value streams between propagators. Let Z G Ob(W) be a black box, 
let n G Ob(Fin) be a finite set, and let Y: n Ob(W) be an n-indexed set of black boxes. 
A morphism ip: Y Z in W is little more than a supplier assignment s,i,: Dm,/. —> Sp^. In 
other words, it connects each demand wire to a supply wire carrying the same set of values. 
Therefore, if a propagator is installed in each black box Y(i), then ip tells us how to take each 
value stream being produced by some propagator and feed it into the various propagators that 
it supplies. 

Announcement 3.3.3 (V on morphisms). Let Z G Ob(W) be a black box, let n G Ob(Fin) 
be a finite set, let Y: n —> Ob(W) be an n-indexed set of black boxes, and let ip: Y Z be a 
morphism in W. We must construct a function 

V(iP):V(Y(l))x---xV(Y(n))^V(Z). 
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That is, given a historical propagator gi G Hist 1 (vsetwyvo), vset out ( V -(, : ^) for each i G n, 
we need to produce a historical propagator V(ip)(gi, ■ ■ ., g n ) € Hist 1 (vset in (£), vset out (^)). 
Define g G Hist 1 (vset ln ( i -),vset out (y)) by g := ® ien gi, as in Remark 3.3.2. Let inDm^ = 
in(Y) H DN,p and inSp^ = out(Y) H DN denote the set of internal demands of ip and the 
set of internal supplies of ip, respectively. 

We will define V(ip){g) by way of five helper functions: 

S,j, G Hist 0 (vset vset 

S'^, G Hist 0 (vsets Pv ,, vsetinDmp ,)i 

S $ G Hist 0 (vsetj„5 p ^,vset out(Z )), 

E^ tB G Hist 1 (vset inDTOi/j , vsetjnSpv,), 

C^,g e Hist 0 (vset ln(z) , vset S pJ, 

where we will refer to the S$,SL,S'l as “shuttle”, E,p g as “evaluate”, and C,j lg as “cascade”. 
We will abbreviate by in (Z) the set List(vset in ( Z j), and similarly for Sp^, inDm y,, etc. 

By Announcement 2.2.3, a morphism ip: Y —> Z in W is given by a tuple (DN^, vset, s,p), 
where in particular we remind the reader of a commutative diagram 
Dm^ 


Sp,i, Set* 


where we require s^,(out(Z)) C inSp.p,. The function Sp,: Dm,/. — > Spp, induces the coordinate 
projection function 7r s</ ,: vsets P0 — y vset r>m^ (see Section 1.2). Applying the functor List 
gives a O-historical function (see Lemma 3.2.3), List(7r S)/) ) which we abbreviate as 

S ^: Sp^ ^ Dm^. 

This is the function that shuttles a list of tuples from where they are supplied directly along a 
wire to where they are demanded. We define a commonly-used projection, 


S:= i t inDm ^ o : Sp </, -A inDm 

The purpose of defining the set inDm^ of internal demands above is that the supplier assign¬ 
ment sends out(Z) into it, i.e. we have s i/j\ out ^ Z ) : out (^) -A inSp^ by the non-instantaneity 
requirement. It induces 7T g | : vset i n s Pi , -A vset out (^). Applying List gives a O-historical 

function List(-7r | ) which we abbreviate as 

S": inSp^ -A out (Z). 


Thus S' and S" first shuttle from supply lines to all demand lines, and then focus on only 
a subset of them. Let <5^ G Hist 1 (vset div, /} , vset on,,, ) be the 1-moment delay. Note that if 
DN W = 0 then 6^: {*} -A {*} carries no information and can safely be ignored. 

We now define the remaining helper functions: 


( 16 ) 


V’.s id x 

■= E ^ g 0 ^ 0 c^gidi)) 


if |*| = 0 
if |*| > 1. 
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The last is an inductive definition, which we can rewrite for \£\ > 1 as 
= (id in(2) X (E^.g o5jo Ci/, } g o 8 )) O A, 

where A : in(.Z') —> in(Z) X in (Z) is the diagonal map. Intuitively it says that a list of length 
t on the input wires will produces a list of length t on all supply wires. By Lemma 3.2.3 E,^ g 
is 1-historical and C\p t g is O-historical. 

We are ready to define the 1-historical function 

(17) Vmg) = S , ;oE^ g oS! ll ,oC^ g . 


0 


Remark 3.3.4. The definitions of S'^ and E,j. tg above implicitly make use of the “zipwith” 
functions 

Y : i n(Z) Xn inDm-tp ——> Dm ^ and Y : in(Y) Xn DN^ ——» inDm,p , 

respectively. In section 3.5 we will make similar abuses in the calculations; however, when 
commutative diagrams are given, the zipwith is made “explicit” by writing an equality between 
products of streams and streams of products when we mean that Y should be applied to a 
product of streams. 


3.4. Running example to ground ideas and notation regarding V. In this section we 
compose elementary morphisms and apply them to a simple “addition” propagator to construct 
a propagator that outputs the Fibonacci sequence. Let X,Y,Z G Ob(W) and <p\ X —> Y and 
ip: Y —> Z be as in (12) and (13). Let N = (N, 1) G Set* denote the set of natural numbers 
with basepoint 1. We recall the shapes of X. Y, and Z here, but draw them with different 
labels: 


^ “ + ” 



“1 + E” 


“Fib” 


—>Cx 

a Y - 


->Cy 



We have replaced the symbol X with the symbol “ + ” because we are about to define an 
X-shaped propagator “+” G V{X). Given an incoming list of numbers on wire ax and another 
incoming list of numbers on wire bx, it will create a list of their sums and output that on Cx- 
More precisely, we take : List (IV xff)-> List (TV) to be the 1-historical propagator defined 
as follows. Suppose given a list i G List (A x N) of length t, say 

[4(1),4(2),...,4(4] y [4(1),4(2),...,4(*)] 

Define *'+”(!) G List (TV) to be the list whose nth entry (for 1 < n < t + 1) is 


|4(n-l)+4(ri-1) if2<n<t+l 

So for example “ + ”([4,5,6,7] Y [1,1,3,7]) = [1,5,6,9,14]. 

We will use only this “ + ” propagator to build our Fibonacci sequence generator. To do so, 
we will use wiring diagrams <p and ip, whose shapes we recall here from (13) above. 
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“1 + £” = P(0(“ + ”) 
“1 + E” 



“Fib” = Vty){“l + E”) 
11 Fib” 


cz 



The T-shaped propagator “1 + E” = V(<p) ('"+”) G V(Y) will have the following behavior: given 
an incoming list of numbers on wire ay, it will return a list of their running totals, plus 1. 
More precisely “1 + £”: List (TV) —»• List (TV) is the 1-historical propagator defined as follows. 
Suppose given a list l € List(TV) of length t, say £ = [4, 4,..., £ t ]. Then “1 + £”(£) will be the 
list whose nth entry (for 1 < n < t + 1) is 


(18) 


“l + S”(<)(n) = l + ^4 


But this is not by fiat—it is calculated using the formula given in Announcement 3.3.3. We 
begin with the following table. 


Calculating “1 + £” 




</,“+»(£) € cx 

6V'+”(4 e {av,c x } 

RCwM G {a x ,bx} 

} 

[] 

U 

1] 


4] 

4]Y[1] 

4]Y[1] 


1,1 + 4] 


4,4] 

4,4] y [l, 1 + 4] 

4,4] Y [1,1 + 4] 


1,1+4,1+4 + 4] 


4,4,4] 

...,4]Y[..., 1 + 4 + 4] 

■ ■ ■ ,4]y[. .., 1 + 4 + 4] 


. ■ •, l + 4 + 4 + 4] 

[4,...,4] 

[■.-,4]y[...,i + e:-: 1 1 ^] 

[...,4]Y[...,i+En4] 

[•••,1+EL, 4] 


where the last row can be established by induction. The ellipses (...) in the later boxes indicate 
that the beginning part of the sequence is repeated from the row above, which is a consequence 
of the fact that the formulas in Announcement 3.3.3 are historical. We need only calculate 

“i+ e”(£)== s; ° o s; ° cv + »w 

1,1 + 4 ,i+ 4 + 4 ,...,i + £> 


just as in (18). 

The Z-shaped propagator "Fib” = - P('0) (“1 + £”) e V(Z) will have the following behavior: 
with no inputs, it will output the Fibonacci sequence 

“Fib” () = [1,1,2,3,5,8,13...]. 

Again, this is calculated using the formula given in Announcement 3.3.3. We note first that 
since in(Z) = 0 we have vset ln ( 2 ) = {*}, so in(Z) = List(vset ln (^) = List({*}). 
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As above we provide a table that shows the calculation given the formula in Announcement 
3.3.3. 


Calculating “Fib” 


cv,“ i+e-W 

e { c Y ,d4,} 

S^,“ 1+ E”W 

e {ay,d^} 

e { c Y ,d 

] 


] 

1JY[1] 

*] 

1]Y[1] 

1]Y[1] 

1,2] Y [1,1] 

*,*] 

1,2] Y [1,1] 

1,1] Y [1,2] 

1,2,3] Y [1,1,2] 

*,*,*] 

1,2,3] Y [1,1,2] 

1,1,2] Y [1,2, 3] 

T, 2,3,5] Y [1,1,2,3] 

*,*,*,*] 

1,2,3, 5] Y [1,1,2,3] 

1,1,2, 3] Y [1,2,3,5] 

1,2,3,5,8] Y [1,1,2,3,5] 


In the case of a list t £ List({*}) of length t, we have 


“Fib”(n) = T(^)(“ 1 +£")(*) 


1,1,2,3,...,! + J2“Fib”(i) 


Thus we have achieved our goal. Note that, while unknown to the authors, the fact that 
“ Fib”(t ) = 1 + Xa=i “ Fib”{i ) was known at least as far back as 1891, [Luc]. For us it appeared 
not by any investigation, but merely by cordoning off part of our original wiring diagram for 
“ Fib”, 


“Fib” 



Above in (14) we computed the supplier assignment for the composition WD, to := X —> 
Z. In case the above tables were unclear, we make one more attempt at explaining how 
propagators work by showing a sequence of images with values traversing the wires of u applied 
to “+”. The wires all start with the basepoint on their supply sides, at which point it is shuttled 
to the demand sides. It is then processed, again giving values on the supply sides that are again 
shuttled to the demand sides. This is repeated once more. 


“Fi6”-Supply (iter. 1) 


“Fib ”-Demand (iter. 1) 


“Fib”-Supply (iter. 2) 
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“F'ifr-Demand (iter. 2) 


“Fib ”-Supply (iter. 3) 

_ U. 13 2 


“FW’-Demand (iter. 3) 







One sees the first three elements of the Fibonacci sequence [1,1,2], as demanded, emerging 
from the output wire. 


3.5. Proof that the algebra requirements are satisfied by V. Below we prove that V, 
as announced, satisfies the requirements necessary for it to be a W-algebra. Unfortunately, the 
proof is quite technical and not very enlightening. Given a composition ui = 'ip o 0, there is a 
correspondence between the wires in ui with the wires in %[) and (j>, as laid out in Announcement 
2.2.8. The following proof essentially amounts to checking that, under this correspondence, the 
way Announcement 3.3.3 instructs us to shuttle information along the wires of cv is in agreement 
with the way it instructs us to shuttle information along the wires of if and <p. 

Theorem 3.5.1. The function V: Ob(W) —i Ob(Sets) defined in Announcement 3.3.1 and 
the function V: W(Y;Z ) —> Homsets (V(Y);V(Z)) given in Announcement 3.3.3 satisfy the 
requirements for V to be a W-algebra. 

Proof. We must show that both the identity law and the composition law hold. This will require 
several technical lemmas, which for the sake of flow we have included within the current proof. 

We begin with the identity law. Let Z = (in(Z), out(Z), vset^) be an object. The supplier 
assignment for idz: Z — > Z is given by the identity function 

s idz : out(Z) II in (Z) —in (Z) II out (Z). 

Let / e P(Z) = Hist 1 (vset ln ( Z ), vset out ( Z )) be a historical propagator. We need to show that 

V(id z )(f) = f. 

Recall the maps 


Sidz : S Pidz "A -DTOidz > 

E\,\ Z J : in(Z) inSp id , 


S'idz : Spidz ~ ^ inDmidz ) 
C idz j: in (Z) ->• Sp idz , 


S[ dz : inSpid z -A out (Z), 


from Announcement 3.3.3, where inSpu\ y = out {Z). 
Lemma 3.5.2. Suppose given a list i £ in(Z) . We have 


CidzjW = 


0 

(Ef(di)) 


if |^| = 0, 
if |^| > 1. 


Proof. We work by induction. The result holds trivially for the empty list. Thus we may 
assume that the result holds for dt (i.e. that Ci dz j(d£) = (d£, f(dd£) holds) and deduce that 
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it holds for l. Note that S[ dz ([ ]) = [ ] and £ idz j([ ]) = /([ ]). By the formulas (16) we have 
C idzJ (£) = (id-^y x (E idzJ O s' idz O C idzJ O d)) O A(£) 

= ( id ^Z) >< Wo*,/ ° ° C **,f ° V) & *) 

= ( id ^zj( £ )> E idz,f ° s u z ° ° m) 

= (£,E idzJ oS' idz (d£,f(dd£))) 

= (£, E idzJ O 7 T inDmidz O s idz (d£, f(ddt ))) 

= (*> ° / W)) 

= (f!,£ idz ,,(£>£)) 


Expanding the definition of P(id z){f)(£) we now complete the proof that the identity law 
holds for V: 

V(id z )(f)(t) = o E idzJ o S[ dz o C ldzJ {£) 

= S^ z oE idzJ oS{ dz (£,f(d£)) 

= S” dz o E idzJ o o S idz (£, f(d£)) 

= s{' dz o E idzJ o 7 f{dt)) 

= S^ z oE idz j(i) 

= S& z (f(£)) 

= m- 


We now move on to the composition law. Let s: m —> n be a morphism in Fin. Let 
Z £ Ob(W) be a black box, let Y : n —t Ob(W) be an n-indexed set of black boxes, and let 
x: m —> Ob(W) be an m-indexed set of black boxes. We must show that the following diagram 
of sets commutes: 

Wn(Y;Z) x Ui£n W rn i ( X i :Y(i)) -—- ^ W m (X; Z) 



Sets n (P(Y);P(Z)) x ]J ien Sets mi (P(Xi); P(Y(i))) Sets m (P(X);P(Z)) 

Suppose given ip-.Y-tZ and (pi: X, —> Y(i) for each i, and let (p = 0, ( Pi '■ X —> Y. We can 
trace through the diagram to obtain V(ip)o Sets P((p) and P(ipo w cp), both in Sets TO ('P(X); P(Z))) 
and we want to show they are equal as functions. From here on, we drop the subscripts on o_, 
i.e. we want to show P(ip) o P((j>) = P(ip o cp). 

Let c o = ip o <p. An element / £ V(X) = Hist 1 (vset in ( X) , vset out pn) is a 1-historical 
propagator, /: in(A') -A out(X). We are required to show that the following equation holds 
in P(Z): 


(19) 


V(lP) a Vmf) =?(“)(/)■ 
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Expanding using the definition (17) of V (ip) oV((/>)(f) and V(ui)(f) we see that this translates 
into proving the commutativity of the following diagram: 

inSp^v -—-#* out ( JfJ -—- ^inSp u 

E ^,g E »,f 

inDmq, ? inDm u 


where we abbreviated g = V(4>)(f). To do so, we must prove some technical results (Lemmas 
3.5.3, 3.5.4, and 3.5.5) which assert the equality of various demand and supply streams flowing 
on the composed wiring diagram w = ip o <j>. 

The ultimate proof of (19) will be inductive in nature. That is, to prove that the result 
holds for a nonempty list l of length t > 1, we will assume that it holds for the list di of length 
t — 1. More precisely, to prove (19) we will need to know the following equality of functions 
in(Z) —> inDm w 

(20) S' u o C uJ = ( S ^ X id) o (C M X id) o S', o C^ g 

and this is proven by induction on the length of i £ in (Z). The base of the induction is clear 
after recalling that definition (16) gives C w ,/([ ]) = [], ]) = [ ] and C^ |S ([ ]) = [], and 

that SL and s' u are 0-historical. 

The next three lemmas carry out the induction step and assume the following induction 
hypothesis regarding the equality of functions in (Z) —> inDm u 

(21) SI o C uJ o d = (5; x id) o (C+J x id) o ^ o C^ g o d. 

Lemma 3.5.3. If we assume that equation (21) holds then the following diagram commutes: 

in(Z) -—->- Sp w 




Spq, 

in other words, we have the following equality between functions in (Z) —> Spq,: 

(22) C^ vmf) = (id X S'l X id) o C uJ - 

Proof. For convenience we will abbreviate g = V(4>)(f). It follows from our induction hypothesis 
(21), the internal square in the following diagram (when composed with (id x d) o A: in (Z) —> 


in(Z) x inSp^ x DNq, 
jidxS^xid 

MZ) x out(y) x DN,p 


Sp,/, - 
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i n(Z) X in .(Z)) commutes: 


i n(Z) -—- Sp U 



Spj, = in(Z) X inSpj, in(Z) x out( X, xjAjT 


The top square and left square commute by definition of C u j and C^j respectively, see 
(16). The square E u j = E^j x S( commutes also by definition (16). The commutativity of 
the bottom-right corner of the diagram translates into the following identity between functions 
inDm^ —> out(T) x DN,p: 

E i>,vmf) = t S * x id ) ° ( E *J x S D ° x id) o (C M x id). 

But this is a direct consequence of the definitions E = ^ > (0)(/) x 4J, an( l T(0)(/) = 
Sq o Epj o S'i o It follows that the outer square commutes. 

□ 

Lemma 3.5.4. If we assume that equation (21) holds, then so does the following equality of 
functions in (Z) —> inSp 5 

( 23 ) ^inSpf ° = ^inSpt ° @+,1 ° k(yj ° ° 

Proof. We will use the following three “forgetful” equations, 

(24) E *,S ° ° SL = ° ( E *,f x 4) ° , 

(25) o E uJ o S' o C uJ ° d = o (id^ x (E uJ o S' o C u , f ° d)) o A, 

(26) Em o S’t o Cm o d = o (id-^ x (Em o S'j, o Cm o 9)) o A, 

(27) S't O C^J O 7T in(y) = o (fy x id) o (C W x id). 

which are “obvious” in the sense that they are simply a matter of tracking coordinate projec¬ 
tions. The proof will go as follows. We apply E^j o n inDm to both sides of the assumed 
equality (21) and simplify. On the left-hand side we use (24) then the fact that by definition 
we have 

(28) E U J = Em X si, 

then (25), then the definition of C u j which we reproduce here: 

(29) c uJ = X (Em o si o Cm ° a)) o a 


5 It is possible for one to draw a diagram representing this equation as we did in the preceding lemma, however 
we did not find such a diagram enlightening in this case. 
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to obtain the following equality of functions in (Z) —> inSpj,: 

=<“> .(%x4|o?,.C„,.8 

= <28, ^°-E»,/°s> a.,,., a 

= (251 ° (1*5® X ( E ».f ■> St ° C»,/ ° 8)) ° A 


On the right hand side we use (27), then commute the d, then apply (26), and then the definition 
of Cm which we reproduce here: 

(30) C M = (id~^- x (E^j o S ; o Cm od))oA 

to obtain the following equality of functions in(Z) —> inSp 

Em o 71^5^0 (s; X id) o {Cm X id) o s; o Cm o d 

= (27) Em ° o Cm ° %p?y 0 5; o cv i9 o d 

= 0SJ0 C^j o d o Trappy 0 &g>, g 

= (26) "*3* 0 x @*,f °5;oC w o9))oAo W s;o £7,* 




Combining these computations with the induction hypothesis (21) gives the result: 



= e M 0 0 ( S 4 , x id ) 0 (' C M x id) 0 ^ 0 ^ 0 9 

= ^-Omo^oS^Cm. 

□ 

Lemma 3.5.5 (Main Induction Step). If we assume that equation (21), reproduced here 
(21) S' u O C uJ O d = ( 5 ; x id) O {Cm x id) o 5 ; o cv, s O d, 

holds, then equation (21) holds without the precomposed d, i.e. we have the following equality 
of functions in(Z) —> inDm 

Si o Cm = (s; X id) o {Cm X id) o 5; o Cm- 

Proof. To keep the notation from becoming too cluttered we adopt the following convention: 
an identity map written as the right hand term of a product will always mean id DV , while 
an identity map written as the left hand term of a product will mean one of i d la yy , id ont ^ y y , 
id in(z) , or ^ oat(K) ’ w iiich one should be clear from the context. 

The proof will be by cases, we show for each j £ inDm u that 

o (S' X id) o {Cm X id) O 5 ; o Cm = 7Tj o O C uJ , 
i.e. we show that the two ways of producing internal demand streams agree by checking wire 
by wire. Since inDm u = inDm$ II DN\p, there are three main cases to consider: j £ DN^, 
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j £ inDm $ with s^(j) £ in(y), and j £ inDm $ with s^ij) £ inSp We go through these in 
turn below. Most of the necessary equalities will use that shuttling streams between outputs 
and inputs does not change the value stream. 

(1) Suppose j £ DN^. We use Lemma 3.5.3 and the fact that the right hand identity maps 
are i d DN to see 

T? o (S£ x id) O (C M X id) o Sip oCfcfl 

= (22) 7Tj o (s; x id) o (c+j x id) o s; o (id x s; x id) o c uj 

= ixj oSjjo (id x S'l x id) o C u j 
(*) = 7r «^ ( i) o (id x x id) o C m j. 

Now there are two cases depending on what has supplied wire j. 

• Suppose £ in (Z) II DN Notice that in this case (11) gives s^(j) = s u (j). 

Then (*) above becomes 

7 r »^Cj) ° ^^in(Z) X X idpJV^) ° = Ws *0) ° ° C U J 

= 7 Tj O S' u O C u ,f 


• Suppose s^(j) £ out(F). In this case (11) gives o s^(j) = s u (j). Because 
Sj, = w s | : inSp$ — fe out(T), we see that (*) simplifies as 

^(j) 0 (id x S'l x id) 0 Cuj = T'VO') 0 0 ^inSp^ 0 

= ^oa^j) ° CW = 7 I Su (j) ° 

= *ioSt,oC u , f . 


(2) Suppose j £ inDm$ and S 0 (j) G in(y). We will use Lemma 3.5.3 and the equation 
v j 0 x id) = 7r s^.(i)- 

We will also use the fact that tt*^) o (C^j x id) = 7 r a4> (j), which holds because s^(j) £ 
in(T) and C$j is the identity on in(y). With these in hand we compute: 

T? o (S£ x id) o (C M x id) oSjo C^ g 

= (22) TXj o (s; x id) o (Cm x id) o s; o (id x s; x id) o c Utf 

= 0 (G*,/ x id) 0 S* o (id x S'l x id) O C U J 

= *■-*(#) (id x S'; x id) O C uJ , 

(**) = K., pas jj) o (id x s; x id) o C uJ , 

There are again two cases to consider depending on what has supplied wire j: 

• Suppose s,/, o s r f,(j) £ in(Z) II DN^. Then we get 

° ( i( iii(zy X X ^DN^) = ^s^os^d)- 
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Now (11) implies the identity o s$(j) = s u (j ) and thus (**) becomes 

Ks^os+ij) ° (id X S'l X id) O C uJ = TTs^os^j) ° C “J = ***U) ° C “J 
= TTj O O C uJ . 


Suppose s-^ o s^,(j) e out(F). Then notice that by (11) we have s w (j) = s^o s^o 
s^(j) and (**) simplifies as 




(id x S'l x id) o G mJ = 


7r «*°**£#> ° S 4> ° 'XinSpt, ° C <»,f 

^s^os^j) ° C U J = W au (fl O C uJ 
n j0 S' u oC uJ . 


(3) Suppose j G in D nip and s ( p(j) G inSp p. As usual we have ttj o S' c l = but noting 

that vsetj = vset s /p, the assumptions on j imply that we have 

n i oS '<l> = ^(i) ° 

In this case (11) gives s u (j) = and thus by Lemma 3.5.4, 


TTj o (££ x id) o (Cpj x id) oS'o 

= 7 Tj 0 S 4 O Cpj O 7T ln ^ y y °S^O C^j t g 
= W sp,{j) ° n i n Spp ° tytf ° 7r in(V) ° ° 

= *•„<# 0 C “J 
= 7 Tj oS'o C u ,f. 


□ 


To complete the proof of Theorem 3.5.1 recall that we have been given morphisms <f>: X —)■ Y 
and ip: Y —)• Z and u> = ij) o <f> in W with notation as in Announcement 2.2.8. These have 
corresponding supplier assignments sp, s^, and s u . Abbreviate g = : in(T) — > out(F). 

Consider the following diagram of sets: 
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inSp^ ---A*?out(F) ^-—- inSpu, 



Recall that our goal was to show that the outermost square commutes. We will see that 
each inner square is commutative in the sense that the following equations hold: 

S" = S'^o (fl^ x id): inSp^ x DN^ —> out (Z) 

= inDm,p —»■ out(F) x DN]p 

gxSl = {S'J, x id) o (E^j x Si) o (5; x id) o (C 0>/ x id): i^F) x DN .£ -> ^t(F) x 
E<t>j = E u j: inDm</, x PA r v —> inSp u 
S' u o C u , f = (5; x id) o (C^j x id) o 5 ; o C ^ g : in(F) —> ^0^) 


The first follows from Lemma 2.2.7, especially (9), and Announcement 2.2.8, especially (11). 
The next three follow directly from definitions (16). The last equality has been proven in 
Lemma 3.5.5. 

It follows that the equation below holds for functions in(Z) —> out (Z): 

V(u)(f) = S'' o E a>f o si o c uj = S'; o E^ g o s; o c^ g = vm 9 ) = vw o vmf) 

Indeed, the left-hand equality and the second-to-last equality are by definition of V on mor- 
phisms, as given in (17). The second equality is found by a diagram chase using the six equations 
above. □ 


4. Future work 

The authors hope that this work can be put to use rather directly in modeling and design 
applications. The relationship between the operad W and its algebra V is quite explicitly a 
relationship between form and function. The ability to zoom in and out, i.e. to change levels of 
abstraction with ease is a facility which we believe is essential to any good theory of the brain, 
computer programs, cyber-physical systems, etc. 

Below we will discuss some possibilities for future work. We see three major directions in 
which to go. The first is to connect this work to other work on wiring diagrams. The second is 
to consider applications, e.g. to computer science and cognitive neuroscience. The third is to 
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investigate the notion of dependency, or cause and effect, in our formalism. We discuss these 
in turn below. 

4.1. Connecting to other work on wiring diagrams. While wiring diagrams have been 

useful in engineering for many years, there are a few mathematical approaches that should 
connect to our own, including [ DF] , [E ] , [DL] , and [ ]. 

The work by [AA] ] studies dynamics inside of strongly connected (transitive) networks of 
identical units. Their main aim is to relate the dynamics on the network to properties of the 
underlying network architecture. The underlying network should be viewed as analogous to a 
morphism ip in W, while the dynamics lying over the network should be viewed as analogous 
to the morphism V{ip). The cells in their networks are considered to have internal states which 
collude with the inputs to produce the output of a cell. There exists an algebra over W of 
“propagators with internal states” and a retract from this algebra to V, which should allow the 
transfer of results of [AADF] to our framework. Arguably one of the main aims of [AADF] is 
to introduce a notion of inflation for these networks. A careful comparison, see for example 
[AADF, Figure 15] and [ \.DF, Figure 29], reveals that their inflation procedure is a special 
case of the composition of morphisms in W where the black boxes being inserted into a wiring 
diagram come from a special class called inflations. 

In [BB], the authors investigate reaction networks and in particular stochastic Petri nets. 
There, various species (e.g. chemicals or populations) interact in prescribed ways, and the 
dynamics of their changing populations are studied. A similar but more complex situation is 
studied in [DL]. Both of these papers work with continuous time processes, whereas we work 
with discrete time processes. Still, we plan to investigate the relationship between these ideas 
in the future. 

The only other place, other than the present paper, where operads are explicitly mentioned in 
the context of wiring diagrams seems to be [Sp2], where the author studies systems of interacting 
relations using an operad T. One might think that an operad functor would appropriately relate 
it to the present operad W, but that does not appear to be the case because of the delay nodes 
that exist in W but not T. Instead, these two operads need to be compared via a third, in 
which delay nodes do not occur, but wires are still directed. We hope to make this precise in 
the future. 

4.2. Applications, e.g. to computer science and cognitive neuroscience. The authors’ 
primary purposes in the above work was to formalize what we considered fundamental principles 
in the relation of form and function in both computers and brains. On the operad/form level we 
are speaking of hierarchical chunking; on the algebra/function level we are speaking of historical 
propagators. 

One can ask several interesting questions at this point. For example, can we create from W 
and V a viable computer programming language? We would hope that the propagators given 
by computable functions are closed in, i.e. form a subalgebra of, V. But perhaps one could ask 
for more as well. For example, if each transistor in a computer acts like a NOR gate, one could 
ask whether or not the subalgebra generated by NOR gates is Turing complete. We conjecture 
that something like this is true. If so, we believe our language will provide a simple, grounded, 
and useful perspective on the actual operation of computers. 

There are also many interesting questions on the neuroscience side that motivated this work. 
These essentially amount to a question of “what”. What is a neuron? What is a brain? 
What is the relationship between the actions of individual neurons and the brain as a whole? 
It is easy to imagine that a neuron is simply a black box where we assign certain multisets 
of neurotransmitters to each input and output, the historical propagators would then record 
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activity patterns of discretized neurons. If this turns out to be the case then the distinction 
between neuron and brain becomes blurred, each is simply a black box with some specified 
inputs and outputs. From this perspective the questions of how the activity of individual 
neurons relates to the activity of a functional brain region or of the entire brain becomes 
subsumed by the operad formalism where we can think of each as a different choice of chunking 
within a single (massively complex) wiring diagram representing the connections occurring 
within an entire brain. Deep questions regarding precisely how the actions of neurons in one 
part of the brain influence the activity in other areas will rely on the work of neuroscientists’ 
understanding of the precise wiring pattern of the brain and remain to be understood. We will 
speak more on these questions of dependency within our formalism in the next section. 

4.3. Investigating the notion of dependency. Given a propagator with m-inputs and n- 
outputs, one may ask about the relation of dependency between them. When one says that the 
outcome of a process is dependent on the inputs, this should mean that changing the inputs 
will cause a change in the outputs. 

In one form or another, the ability to track changes as they propagate through a network 
of processes is one of the basic questions in almost any field of research. Indeed, concern with 
notions of cause and effect is an essential characteristic of human thought. Making mathematical 
sense of this notion would presumably be immensely valuable. In particular, it should have 
direct applications to neuroscience and computer programming disciplines. 

It is not clear that there exists a reasonable notion of causality that is algebraic in nature, 
i.e. one that can be formulated as a W-algebra receiving a morphism from V. In that case we 
may look to other approaches, e.g. that of Bayesian networks as in [I ] and [Foil]. Whether 
Bayesian networks also form an algebra on W or a related operad, and how such an algebra 
compares with V should certainly be investigated. 
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